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RDECona^  Intelligent  Ground  Systems 

Overview 


Furthering  Unmanned  Systems  Autonomy 

•  Unmanned  Ground  Vehicle  Platforms 

•  Vehicle  Intelligence  and  Control 

•  Mission  Payload  Integration 

•  Embedded  Simulation 


Increasing  Crew  Interface  and  Control  Capabilities 

•  Human-Robot  Interaction 

•  Advanced  Soldier  Machine  Interfaces 

•  Embedded  Simulation 
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RDECO!^^  Autonomous  Systems  Programs 


TF^rtiDtE 


FY07 


FY08 


FY09 


FY10 


Near  Auton< 

smous  Unmanned  Systems  ATO  , 
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Robotic  Vehicle  Control  Architecture  for  FCS  ATO 
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A 
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Autonomous  Platform  Demonstrator  (APD) 


I 


RC  ATO 


Covered  on  separate  chart 


i: 


'  Safe  Operations  of  Unmanned  Systems  for  Reconnaissance 
IJHJI  in  Complex  Environments  (SOURCE)  Proposed  ATO 


Convoy  Active  Safety  Technologies  (CAST) 


m 


T  L 


Joint  Convoy  Active  Safety  System  (JCASS) 


m  I 

r 

ri 

L"' 

TAGS-CX  Robotics  Skunkworks 

r" 

t  k 

k  I 

k 

RS  JPO  Large  Wheeled  Robot  Development  and  Support 


Small  Tracked  Robot  SBIR 


JZ 


I  I 

Collaborative  Manned 
■P-  and  Unmanned 
Mission  Execution 


Current 


Proposed 


Planned 
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ick^HNOLOGY  driven.  iWinrfVTnfcn 


Robotic  Security  for 
Maneuver  Elements 


Crew  Interface  and  Control 
Programs 


RDECOM 


FY07 


FY08 


FY09 


FY10 


FY11 


ii 


Robotics  Collaboration  ATO 


L 


I 


m 


I  Increased  Mobility  and  Operational  Performance  through 
Autonomous  Technologies  (iMOPAT)  Proposed  ATO 


Unmanned  Systems  Safe  Operations 


rTTT 


Soldier  Awareness  through  Coiorized  Ranging  (SACR) 


r - r - r 


Micro  Vision  Congressionai  Add 


r 


Think-A-Move  SBiR 


rujLm  co^sAi  SrSims 


Q 

l 


Cross  Command  Coilaborative  Environment  (3CE) 


£ 


NAUS  ATO 


RVCA  ATO 


SUOUE  P-ATO 


Robotic  Security 


Covered  on  separate  chart 


Coiiaborative  Manned 
and  Unmanned 
Mission  Execution 


Current 


Proposed 
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h^CHNOLOGY  driven.  vvMnriijnicn 


Intelligent  Ground  Systems 
RDECon^  Research  Focus  Areas 


Intrinsic  Mobility 


Inteiligent  Mobility 


Autonomous  street  following 


Autonomous  perimeter  following  demonstration 


Innovative  Control 


Advanced  Sensors 


Adaptive  Payloads 


PL2T 


Ad^tive  OCU  and  Man^ulator  and  Modular 

Controller  Dual  Conununications  Package  Tool  Attachments 
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RDECOM 


S&T  Activities  -  Technicai 
Capabiiity  Areas 


TF^nSDtEi 


Perception 


Intelligence 


•  Vehicle  intelligence  •  Collaboration 

•  Tactical  behaviors  •  Mission  specific  behaviors 


Command  &  Control 

•  Operator  control  interface 

•  Battle  command  integration 


Safety 

•  Vehicle  safety 

•  Weapon  safety 


Platform 

•  Mobility  maturation 
•SWaP 
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RDECom^^  Perception  Shortfalls 


Sensors 

•  Extended  range  &  resolution 

•  All  weather  sensing/obscurants 

•  Reduced  size 

Software 

•  Terrain/Feature  classification  at  extended  range 

•  Detection,  classification,  tracking  of  moving 
vehicles,  people,  &  animals  from  a  moving 
vehicle  (object  association/partial  obscuration) 

•  Detection  of  moving  &  stationary  people,  often 
partially  obscured  or  camouflaged 

•  Stand-off  classification  of  mud  or  water  - 
estimate  of  surface  supportability/trafficability 
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RDECO!^^  Intelligence  Shortfalls 


Vehicle  Intelligence 

•  Ability  to  adapt  to  changing  environment  &  learn  from 
prior  experience  or  act  based  upon  general  guidance 

•  Ability  to  project  future  activity  or  courses  of  action 
by  others  and  plan  accordingly 

•  Ability  to  understand  vehicle  health  and  modify  plans 
accordingly 

Tactical  Behavior 

•  Mimic  the  behavior  of  Soldiers  under  similar 
conditions 

•  Continue  autonomous  operation  during  prolonged 
communications  outages 

•  Self-protection 


Coliaboration 

•  Shared  situational  awareness 

•  Teaming  -  robot/robot  and  robot/Soldier 

Mission  Specific  Behaviors 

•  RSTA 

•  Force  Protection 

•  Material  handling/delivery  unclassified 
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Command  and  Control 
RDECO!^  Shortfalls 
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Command  Integration 

•  Fusion  of  local  situation  awareness  information  with  the 
Common  Operating  Picture 


Operator  Control 

•  Situational  awareness  of  what’s  going  on  around  the 
robot/operator  intervention 

•  Scalable  interfaces  -  from  MGV  to  dismount 

•  Operator  workload  in  realistic  tactical  environments 

•  Operator  span  of  control 

•  Alternative  control  modes  (voice/gesture) 

•  Hands  free,  heads  up  display  and  control 
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Safe  Operations 

•  Autonomous  Vehicle  Mobility 

•  Autonomous  Weapon  Control 

Platform  Technologies 

•  High  bandwidth  data  links  and  network  integration 

•  High  density  power  sources 

•  System  modularity/shape  shifting  designs 

•  Micro/miniaturization  and  Bio-mimetic  designs 

•  Condition  Based  Maintenance 


Advancing  Fielde 
Capabilities 
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RDECOM 


Notional  Timeline  for  TARDEC  S&T 
Investment  in  Unmanned  Systems 


FY08  FY09  FY10  FY11  FY12  FY13  FY14  FY15  FY16  FY17  FY18  FY19 


Robotics 

Collaboration 


Near 

Autonomous 
Unmanned 
Systems  (NAUS) 


Increased  Mobility  and 
Operational  Performance 
through  Autonomous 
Technologies  (IMOPAT) 


Intelligent  Soldier 


Awareness  System 


Psionic  Based  UGV 
Controllers 


Safe  Operations  of  Unmanned 
Systems  for  Reconnaissance  in 
Complex  Environments  (SOURCE 


Joint  Convoy  Active 
Safety  System  JCTD 


Combat  Autonomous 
Mobility  System  (JCTD) 


Robotic 

Decontamination 


Learning  and  Adaptive 
Automation  for 
Collaborative  Unmanned 
Systems 


Robotic  Security  Bubble 
for  Maneuver  Elements 


Robotics  Vehicle 
Control  Architecture 
for  PCS 


User  Gaps  used  to  Drive 
S&T  Program  Planning 


Autonomous 
Platform  I 
Demonstrator 


Bio-Inspired  Robotics 

■ 

■ 

■ 

Soldier  Amplifier/ 
Super  Exoskeleton 


PCS  Technology  Gaps* 

•  Higher  levels  of  autonomy 

•  Complex  terrain  agility 

•  Higher  speed  capability 

•  Enhanced  situational  awareness 

•  Improved  navigational  accuracy 

•  Enable  passive  sensors  for  autonomous 
navigation 

•  Enhanced  feature  classification 

•  Vehicle  detection,  classification  and  tracking 

•  Human  detection,  classification  and  tracking 

•  Learning  and  adaptation  in  both  static  and 
dynamic  environments 

•  Mobility  in  dynamic  environment 

•  Situational  understanding  in  dynamic 
environment 

•  Network  constraints 


TRADOC  Technology  Gaps* 

Current  Porce/Near  Term  Gaps 

•  Ability  to  remotely  clear  dangerous  areas  with  robots 

•  Convoy  protection  platform  to  defend  and  secure 

•  Common  robotics  controller 

•  Unmanned  system  teaming 

•  Autonomous  layered  self-defense  for  UMS 

•  UAV  autonomously  launch  and  land  from  moving 
manned  vehicles 

Puture  Porce/Mid  Term  Gaps 

•  Provide  assured  mobility. 

•  Provide  near-real  time  combat  ID  ...  across  the 
spectrum  of  operations. 

S&T/Par  Term  Gaps 

•  Mobile  &  Fixed  360  Degree  Hemispherical  Area 
Protection 

•  Area/route  clearance  at  operating  speeds 

•  Increase  Autonomy  in  control  of  unmanned  systems 

•  Future  Force  Multi-modal  HCI 

•  Detect,  identify,  and  neutralize  CBRN/TIM  agent 
dispersal  modes 


*  Not  an  all  encompassing  list! 
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Ongoing  Program 
Planned  Program 
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Autonomous  Mobility 


Tactical  Behaviors 


Self  Security 


Schedule 


Milestones 


FY06 


FY07 


FY08 


FY09 


Longer  range,  higher  resolution  perception  (ARL) 
Personnel  &  vehicle  detection  &  avoidance  (ARL) 

Tactical  Behaviors  (ARL/TARDEC) 

System  self  security  (TARDEC) 

Remote  weapon  station  (ARDEC) 

Integrated  reduced  workload  human  interface  (ARL) 

Autonomous  unmanned  vehicle  field  exercises  (ARL) 


Capstone  Experiments  (TARDEC) 


Purpose: 

Develop  and  demonstrate  key  robotics 
technologies  to  reduce  risk  for  PM  PCS  (BCT) 
and  increase  the  utility  of  future  unmanned 
systems. 

Product: 

•  Near-autonomous  maneuver  in  environments 
relevant  to  PCS 

•  Validated  tactical  behavior  methodology  and 
integrated  tactical  behaviors 

•  System  self  security  -  fundamental 
technology  for  detection  &  tracking,  and 
responding  to  incoming  threats. 

Payoff: 

•  Unmanned  systems  able  to  meet  PCS 
threshold  operational  requirements 

•  Reduced  burden  on  soldier  &  network 

•  Unmanned  systems  with  greater  survivability 


unclassified 


TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


RBECona^  Robotics  Collaboration  (RC) 
^  Overview 


Unmanned  Ground 
Vehicles 


Unmanned  Air 
Vehicles 


Focus  on  Platoon  and  below  operations 


Schedule 


Purpose: 

Develop  the  tools,  techniques,  &  autonomy  to  maximize 
mounted  and  dismounted  control  of  ground  and  air 
unmanned  systems  and  optimize  Soldier-robot  and 
robot-robot  ground  and  air  teams 

Results: 

•  Increased  OPTEMPO  through  coordinated  Soldier- 
robot  interactions  during  degraded  autonomous  modes 

•  Increased  robot  planning  capability  and  understanding 
of  UV  intent  and  operational  environment 

•  Unmanned  Vehicles  safety  operational  behavioral 
algorithms  and  recommendations  for  TTP  development 

•  Software  for  UAV/UGV  collaboration 

•  UAV  autonomy  and  cooperative  engagement  capability 


MILESTONES 


FY04 


FY05 

FY06 

FY07 

FY08 

Common  scalable  interface  dev’t  (ground  &  air) 
inteiiigent  agents  and  adaptive  automation 
UV  autonomy  &  task  distribution  aigorithms 
UV  coiiaborative  behaviors 
Fiight  Demos 

Modei  Vaiidation  and  Experimentation  (FCS  MGV 
UGV  &  UAV) 


Payoff: 

•  Increased  mission  performance  through  reduction  of 
task  timelines,  robot  interactions,  and  cognitive  burden 
with  increased  adaptive  automation  &  collaboration 

•  Reduced  Soldier  training  burden  through  standardized 
interfaces 

•  Improved  safety  of  operations  around  unmanned 
vehicles 

•  Optimized  span  of  control  for  unmanned  systems 

•  Increased  Soldier/system  engagement  effectiveness 
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Improved  Mobility  and  Operational 
RDECOM^  Performance  through  Autonomous 
— Technologies  (IMOPAT)  Overview 


360/90  Day/Night 
Near-field  Sensor  Coverage 


Soldier  Monitoring 
&  State 


Aovancea 
Crew  Stations 


Integration  Platform 
With  IV  System 


Tnnatsc 


Integrate,  Enhance,  Demonstrate 
360  LSA/Assist-Mob/Soldier  Monitor  &  State 
to  Maximize  Soldier-System 
360  LSA  and  Mobility  Capabiiities 
(Secure  Mobility) 


Schedule 


MILESTONES 

FY09 

FY10 

FY11 

FY12 

M&S  and  Field  Experiments 

a 

A 

[  A  aJ 

\  A  ^ 

-  Task  Analysis 

-  Integrate  Detection  Algorithms 

-  Integrate  Digital  Recording 

-  Integrate  Dismount  System 
Improved  Mobility 

-  Soldier  Task  Balancing 

-  Assisted  Mobility 

Solider  Monitor/State  CS  System 

-  Sensor  Integration 

-  Algorithm  Integration 

-  Integration  Technique 


- 1 

L  1 

Y - 

Y - ^ 

- 3— 

_ 

. ^ 

^ 

Purpose 

Enable  indirect  vision  (IV)  based  Soldier-systems 
(manned/unmanned/Soldier)  to  move  quickly  and  safely  while 
maintaining  360  local  situational  awareness  (LSA)  to  enhance 
operational  performance. 

Product 

•  Advanced  Crew  Stations  integrated  with  360/90  Day/Night  LSA, 
Assisted  Mobility,  and  Soldier  Monitoring  /  State  technologies  to 
improve  Soldier  performance 

•  Quantitative  understanding  (performance  levels)  of  future  indirect 
vision  operations  for  the  movement  and  security  of  Soldier- 
systems  at  a  platoon  and  below  level  when  utilizing: 

•  Assisted  mobility 

•  LSA  system  with  aided  target  cueing 

•  Digital  video  recording  of  360/90  with  intelligent  tagging 

•  Soldier  monitoring  and  state  based  crew  station  (CS)  design 

Payoff 

•  Improvement  in  Vehicle  &  Soldier  Survivability,  Vehicle 
Lethality/Self-Defense  &  Control  along  with  Greater 
Survivability/Lethality  for  Dismount  Soldiers 

•  Two  Mounted  Soldier  ability  to  maintain  360  LSA  with  IV 

•  One  Mounted  Soldier  ability  to  move  vehicle  (manned  or 
unmanned)  quickly  and  safely  with  IV 

•  Data  and  Information  to  feed  programmatic  decisions 

•  Risk  reduction  for  FCS 
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TnnatEC 


TARDEC 

•  Develop  Enhanced  Indirect  Vision  Drive  /  Tele-operation  Systems 

•  Develop  Assisted  Autonomy  Systems 

•  Develop  Warfighter  Machine  Interfaces 

•  Integrate  and  Evaluate 

•  Vehicle  LSA  Systems  (NVESD) 

•  Soldier  Monitoring  &  State  Classification  Systems  (NSRDEC/ARL-HRED) 

•  Assisted  Mobility  (Other  TARDEC  Programs) 

•  Dismount  LSA  Systems  (NSRDEC) 

•  Perform  SIL  and  Vehicle/Field  Experiments 


ARL-HRED 

•  Define  and  Develop  Experimentation  Plans 

•  Work  with  TARDEC  on  Indirect  Vision  Drive  and  Assisted  Autonomy  Systems 

•  Provide  HFE  Support  for  Systems  Development  and  Integration 

•  Develop  Information  Flow  Requirements  and  Algorithms  for  Mobility  and  LSA 

•  Work  with  NSRDEC  on  Soldier  Monitoring  and  Workload  Management  Systems 


CERDEC  NVESD 


•  Enhance  DAS  Sensor  Systems  /  Threat  Detection  Algorithms 

•  Pop-Up  Targeting  and  Gun-Fire  Detection  (before/during/after  shot) 

•  Develop  Digital  Vehicle  LSA  Recording  and  Cueing  System 


NSRDEC 

•  Enhance  and  Transition  Mid-Maturity  Dismount  Soldier  Monitoring  Systems  from  Augmented 
Cognition  Program 

•  Develop/Enhance  Low-Maturity  Soldier  Monitoring  System 

•  Work  with  ARL-HRED  on  Soldier  Monitoring  Systems 

•  Develop  Dismount  LSA  System 
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— ^  Safe  Operations  of  Unmanned  systems  for 
RDECOM^  Reconnaissance  in  Compiex 

Environments  (SOURCE)  ATO  Overview 


Purpose: 

Develop  and  demonstrate  key  robotic  technologies  that 
will  be  required  for  autonomous  collaborative  unmanned 
systems  &  Soldiers  to  conduct  urban  operations, 
permitting  effective  utilization  of  UMS  for  the  full 
spectrum  of  warfare. 

Products: 

•  Integrated  testbeds  and  Soldier  experimentation 
providing  quantitative  performance  data  to  enable 
development  of  TTPs  &  entry  into  future  SDD  programs 

•  Demonstration  of  Improved  UMS  performance  software 
and  algorithms  for: 

-Operations  in  dynamic/urban  environments 


Schedule 


MILESTONE  (FY) 


Technology/Requirements  Assessment 

Perception  &  Control  Technologies 

-  Safe  Operations,  Situational  Awareness 
Tactical/Mission  Behavior  Technologies 

-  Cooperative  &  Dynamic  Behaviors 
Platform  Integration 

Engineering  Evaluation 
M&S  Experiments 
Field  Experiments 
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10 


A 


11 


A 


12 


A 
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-Collaborative  persistent  surveillance 
-Intuitive  supervision  of  UMS  by  Soldiers 
-Tactical  behavior  for  multi-mission  applications 
-Small  robot  autonomy  behaviors 

Payoff: 

•  Safer  operations  of  UGVs  in  proximity  to  pedestrians 
and  vehicles 

•  Increase  in  vehicle  autonomy  to  enable  less  supervisory 
burden 

•  Increased  UGV  situational  awareness 

•  Robust  Soldier/robot  and  robot/robot  teaming  behaviors 

•  Robust  UGV  performance  in  all  environments/conditions 
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TARDEC 

•  Integration  of  technology  &  payloads  into  testbed  platform 

•  Development  &  conduct  of  warfighter  assessment  &  engineering  evaluations 
(capstone  events) 

•  Conduit  to  Battlelabs  for  TTP  developments  &  integration  of  appropriate  technology 
into  testbeds 

•  Technology  maturation  prior  to  integration  (e.g.,  enhanced  robustness,  functionality,  reliability) 

•  Technology  transition  to  acquisition  partners 

ARLA/TD 


•  Develop  perception  sensors  &  algorithms  for  navigation  and  mission  execution  in  dynamic  urban 
environments 

•  Develop  planning  algorithms  for  use  by  heterogeneous  UMS  in  dynamic  environments  with 
adversaries  and  non-combatants,  includes  collaboration  by  UMS  &  Soldiers 

•  Develop  tactical  behavior  for  focused  upon  manned-unmanned  teaming  in  urban  operations 

•  Develop  a  hard-ware-in-the-loop  simulation  to  encompass  vision  based/LADAR  sensing 

ARL/HRED 

•  Conduct  simulations  to  evaluate  soldier-robot  teaming;  trust  in  automation;  tolerance  to 
system  failure; 


•  Evaluate  intuitive  interface  concepts  for  supervisory  control  -  optimization  of  task  allocation 

ARL/CISD 

•  Develop  autonomous  behavior  for  a  SUGV  class  vehicle,  including  assisted  teleoperation 

ERDC 


•Develop  a  physics-based,  multiscaled,  terrain-enriched  virtual  testing  capability. 

•Evaluate  algorithms  for  sensor  fusion 

•Develop  and  evaluate  algorithms  for  UGV  autonomous  tactical  behavior^^^^^^^^-^.^ 
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